All Questions
23 questions
0votes
0answers
30views
How to scroll in a container with Selenium
I am trying to scrape data from the following link: https://m.hollywoodbets.net/betting/1/soccer/todayscoupon/15 On this website, you can scroll the entire page and also within the table of bets. In ...
0votes
2answers
70views
Selenium-Python returning empty text for one specific class or tag in HTML but not visible on webpage
I am using Selenium and Python to scrape a website. The results will be unknown, so I cannot just hardcode to look for specific values (four letter vehicle codes like "UDAR" in this case). I ...
1vote
0answers
115views
ElementClickInterceptedException for https://health.usnews.com/doctors/; Not Clicking the Button
So I'm trying to mine href data from doctors profiles on the page https://health.usnews.com/doctors/new-jersey. My code is using Selenium to host a web server to accesses the website and mine the URLs,...
0votes
1answer
77views
My scraper can only get the first page of html when scrapping an e-commercial platform using selenium
I'm scrapping tmall.com using selenium. Every time my program switch to another page and try to get the source html of the page, it always returns that of the first page. The page displayed in the ...
1vote
2answers
470views
Selenium find_elements(By.CLASS_NAME) partially working but needs to be completely working
So Im doing a bit of webscraping with selenium and Ive found the class for the elements I want to be targeting. Well the problem is that it only slightly works. What i mean by this is that the call ...
0votes
1answer
1kviews
Not able to maximize the window to fullsize using headless chrome Selenium in python
I am not able to maximize the headless chrome window size to full size that is available. I am trying the following but still the window size remains the default(800px,600px). Kindly help me to set ...
0votes
1answer
67views
Can't find element with XPATH despite being found in the console search bar
I'm trying to implement a program that fills certain section of a MS One page, I've been using Python and selenium for this task, I can access the webpage ok, I can send keys in the main page, but in ...
0votes
0answers
61views
Using Selenium to get elements by class name, but I want to limit based on the online status of another class
I am scraping pinnacle.com. Sometimes they have some offline bets and I want to adjust my web scraping to not include the title of the bet if the bet itself is offline. I am making a dataframe and I ...
0votes
2answers
62views
Not able to click on the button using Selenium
<button class="css-obkt16-button" type="button"><span class="css-1mhnkuh">Download CSV</span></button> I am trying to click on the highlighted button 'Download CSV' ...
0votes
1answer
1kviews
How do I get all divs inside of this div using webdriver and selenium?
I am new to webscraping and am trying to scrape a website and would like to get all the elements that have data-feature-id=homepage/story with the ultimate goal of getting a subelement of each of the ...
0votes
1answer
285views
how do those webdriver option arguments work?
options.add_argument('--disable-blink-features=AutomationControlled') options.add_experimental_option('excludeSwitches', ['enable-automation']) options.add_experimental_option('useAutomationExtension',...
1vote
0answers
234views
VBA: Get specific column from webpage using seleniumbasic
I am trying to get a specific columns data which is in a form of table in a webpage to my excel file using VBA, I'm good at opening webpage and log-in and navigate to table area but I'm unable to get ...
0votes
1answer
97views
Error when using selenium (Python) to scrape link from twitter post with conditional find elements by Xpath
I am trying to scrape the links in a twitter post, but the link that I want is under different div tags. There are multiple parent div tags and I am only interested in the links under a specific ...
0votes
1answer
51views
Select tag wont update/populate if handled programatically
I'm on a website (you don't have access) which requires you to choose a car with select tags. Everything works fine if i work manually. However updating things in an automated way does not update ...
0votes
2answers
1kviews
Use Python to Scrape for Data in Family Search Records
I am trying to scrape the following record table in familysearch.org. I am using the Chrome webdriver with Python, using BeautifulSoup and Selenium. Upon inspecting the page I am interested in, I ...